Experts or an Ensemble? a Statistical Mechanics Perspective of Multiple Neural Network Approaches
نویسندگان
چکیده
In the framework of statistical physics, we studied the 'en-semble learning' and the 'mixture of experts', which are the typical re-alizations of the mutiple neural network approach. Generalization capabilities of the two methods are analyzed. We discuss the pro and con of the two approaches, and the possibility of uniied method combining the merit of two approaches.
منابع مشابه
Machine learning algorithms in air quality modeling
Modern studies in the field of environment science and engineering show that deterministic models struggle to capture the relationship between the concentration of atmospheric pollutants and their emission sources. The recent advances in statistical modeling based on machine learning approaches have emerged as solution to tackle these issues. It is a fact that, input variable type largely affec...
متن کاملMonitoring of Regional Low-Flow Frequency Using Artificial Neural Networks
Ecosystem of arid and semiarid regions of the world, much of the country lies in the sensitive and fragile environment Canvases are that factors in the extinction and destruction are easily destroyed in this paper, artificial neural networks (ANNs) are introduced to obtain improved regional low-flow estimates at ungauged sites. A multilayer perceptron (MLP) network is used to identify the funct...
متن کاملThe optimized model of factors effecting on the Merger and Acquisition from multiple dimensions with neural network approach.
Nowadays, firms apply the merger and acquisition strategy for gaining synergy, increasing the wealth of stockholders, economics of scales, enhancing efficiency, increasing the ability to research and develop, developing the firm and decreasing the risk. Developing an optimized model with the ability to identify the effective variables on the merger and acquisition process has a significant ...
متن کاملEnsemble strategies to build neural network to facilitate decision making
There are three major strategies to form neural network ensembles. The simplest one is the Cross Validation strategy in which all members are trained with the same training data. Bagging and boosting strategies pro-duce perturbed sample from training data. This paper provides an ideal model based on two important factors: activation function and number of neurons in the hidden layer and based u...
متن کامل The Quantification of Uncertainties in Production Prediction Using Integrated Statistical and Neural Network Approaches: An Iranian Gas Field Case Study
Uncertainty in production prediction has been subject to numerous investigations. Geological and reservoir engineering data comprise a huge number of data entries to the simulation models. Thus, uncertainty of these data can largely affect the reliability of the simulation model. Due to these reasons, it is worthy to present the desired quantity with a probability distribution instead of a sing...
متن کامل